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1.  Introduction 


This  paper  concerns  a constructive  adaptation  of  the  Borel-Cantelli  lemma  and 
the  variants  of  it  known  as  0,1  laws  [1],  In  general  we  restrict  our 
attention  to  techniques  that  allow  us  to  solve  problems  of  the  following 
variety:  Given  effective  rules  for  constructing  finite  objects  and  measuring 

their  complexity,  when  does  there  exist  an  infinite  object  that  is 
decomposable  into  infinitely  many  finite  parts  that  are  maximally  complex? 

We  choose  to  set  such  problems  in  the  context  of  the  complexity  theory  for 
infinite  strings,  since  results  phrased  in  this  way  have  implications  for 
other  aspects  of  complexity  theory  (e.g.  the  complexity  of  polynomial 
evaluation  [2,3]). 

Let  {0,1}*  denote  the  set  of  all  finite  strings  over  the  alphabet  {0,1}, 
let  {0,1}U  denote  the  set  of  all  infinite  0,1  strings,  and  let  N denote  the 
set  of  non-negative  integers. 

By  a complexity  measure  on  strings  we  mean  a function 

c:  {0,1}*  -+  N. 

There  are  several  natural  examples  of  such  measures:  Let  a c {0,1}*;  then, 

for  instance,  we  can  take  c(aQ,...,a^)  to  be  either 

(i)  the  complexity  in  the  sense  of  [6]  of  the  string 
a0» • • • »ak 

or  (ii)  the  length  of  the  shortest  straightline  program  that 


evaluates  the  polynomial 
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i 

I a.  x 
i=0  k 

with  coefficients  ag....^^. 

From  all  strings  of  length  k,  we  can  choose  those  with  maximal 
complexity  c^: 

c.  = max  {chi  la  | = k}  + 
ae{0,l}* 

With  this  notation,  we  can  phrase  our  problem  more  precisely: 

When  does  there  exist  a e {0,1}W  such  that  (*) 

c(aQ,...,a^  p = c^  for  infinitely  many  k c N? 

Problems  such  as  {*)  have  comcrete  motivation.  Consider  polynomials 
with  0,1  coefficients  that  are  hard  to  evaluate  in  the  sense  of  [3],  that  is, 
polynomials  with  the  property  that  the  0,1  string  obtained  by  concatenation  of 
coefficients  is  of  maximal  complexity.  Conversely,  if  a is  a finite  or 
infinite  string  over  (0,1),  then  a corresponds  in  a natural  way  to  a power 
series 

„ 1° 1 , 
q (x)  = l a x1. 
i=0 

For  | a | < «>,  we  can  take  c(oq,  . . . ,a  _^)  to  be  the  number  of  non-scalar 
multiplications  required  to  evaluate  the  polynomial  q°(x)  by  a straightline 

t We  use  |a|  to  denote  the  length  of  a.  If  a € {0,1}W,  then  by  convention 

I a | - ®. 
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program.  Suppose  that  0(0^, . . . = c^.  Then  by  adaptation  of  (*)  we  ask 
whether  there  is  an  infinite  power  series 

oo 

v i 

E a.  x 

i=0 

for  which  there  are  infinitely  many  hard  initial  segments;  i.e.  for  infinitely 
many  n e N,  the  polynomial 

n i 

E a x 

i=0 

gives  c(aQ,.,.,an)  =cn+2-  A specific  instance  of  this  problem  has  been 
examined  by  Lipton  [3] , who  showed  the  following. 


Theorem  1 : There  is  a power  series 


E a.  x 
i=0 


with  c {0,1},  i = 0,..,§uch  that  for  infinitely  many  n e N 

1/4 


en 


c , ...  ,ct  ) — c . , •—  , 

0 n n+1  log  n 


for  some  fixed  e > 0. 


Our  main  result  is  a step  toward  solving  (*)  in  a more  general  context. 
Let  \ be  the  number  of  strings  a c {0,1}*  such  that  |a|  = k and  c(a)  = c^. 

If  there  exists  a real  c,  0 < c £ 1,  such  that 


for  infinitely  many  n e N.  We  actually  present  two  proofs  of  this  result. 

One  proof  is  an  easy  corollary  of  the  nonconstructive  Borel-Cantelli  lemma. 
This  proof  gives  almost  no  information  regarding  the  string  3 beyond  its 
existence  with  nonzero  probability  — indeed,  all  this  is  provided  by  such  a 
proof  is  an  infinite  set  of  strings  that  satisfy  the  conclusion.  For  our 
purposes,  however,  more  insight  is  needed  into  the  construction  of  6. 

Therefore  we  give  a more  careful  counting  argument,  which  shows  that  if  the 
complexity  measure  c is  a recursive  function  then  the  construction  corresponds 
to  a computation  in  the  Turing  degree  0"  [7].  Thus,  even  when  viewed  as 
a strictly  measure-theoretic  argument,  our  result  carries  independent  interest 
since  it  gives  a constructive  proof  technique  for  a class  of  theorems  whose 
only  previous  proofs  have  been  nonconstructive  existence  proofs  (ErdSs  [4]). 


I 


2.  Red  Trees 


Problems  of  the  form  (*)  can  be  viewed  as  problems  concerning  infinite  trees 
by  making  a simple  observation.  By  way  of  analogy  with  Theorem  1,  we  call 
finite  strings  with  maximal  complexity  hard  strings  and  say  that  an  infinite 
string  is  hard  infinitely  often  if  it  has  infinitely  many  hard  initial 
prefixes.  Since  there  is  a natural  correspondence  between  sets  of  strings 
closed  under  the  prefix  relation  and  trees,  we  will  interpret  (*)  as  dealing 
with  infinite  trees  in  which  nodes  can  be  colored  red  or  white.  A red  branch 
from  the  root  will  be  a hard  string.  We  will  show  how  to  construct  infinite 
branches  that  are  red  infinitely  often  for  trees  having  the  required 
distribution  of  red  nodes. 

By  a red  tree  we  mean  a countably  infinite  binary  tree  whose  nodes  are 
partitioned  into  white  nodes,  denoted  V^,  and  red  nodes,  denoted  VR.  If  T is 
a tree  and  x e V u Vu,  then  T denotes  the  subtree  of  T with  root  x.  For 

K W X 

A c VR  u Vw,  A'  denotes  the  set  of  descendants  of  elements  of  A;  i.e. 

A’  *=  u T . 
xeA  X 

For  any  tree  T and  any  node  x of  T,  d^,(x)  denotes  the  depth  of  x in  T,  i.e. 
the  length  of  the  branch  join  ing  x with  the  root  of  T.  A level  of  T is  the 
set  of  nodes  at  a given  depth;  for  k e N, 

lT(k)  - {x:  dT(x)  - k}. 

If  T is  a red  tree  and  e is  a real  number,  0 < e £ 1,  then  we  say  that 
T is  e-red  if  for  infinitely  many  k e N 


-6- 


UT(k)  n VR|  £ e2k. 

Intuitively,  we  sat  that  T is  e-red  if  there  are  infinitely  many  levels  at 
which  some  fixed  positive  fraction  of  the  nodes  are  colored  red. 

The  key  property  of  e-red  trees  is  established  by  the  following 
theorem. 

Theorem  2:  If  T is  an  e-red  tree,  then  for  some  e'  >0  and  some  x e V„,  T„ 

— — K X 

is  e'-red. 

Proof:  For  any  node  x e VR  u Vy  and  X > 0,  we  define  f(x,A)  as  follows: 

f (x,  A)  = pk[ (Vn)  (n  * k -*■  UT  (n)  n VR|  < A2n].+  (2.1) 

X 

If  there  are  x e VD  and  X > 0 such  that  f(x,X)  = then  for  all  k there 
exists  n ^ k such  that 

UT  (n)  n VR|  i:  A2n, 
x 

and  thus  T Is  A-red.  Hence,  it  is  sufficient  to  assume  that  for  all  x e V 
x K 

and  A > 0 

f(x,A)  < <*> 

in  order  to  derive  a contradiction. 

Choose  d e N,  6 < 0,  such  that 

1 - de  + (d-1) *6  < 0.  (2.2) 

t For  any  predicate  P(v,x^, . . . ,x  ) , py[P(y ,x^, . . . ,xr) ) denotes  the  smallest 
v c N such  that  P(v,x^, . . . ,xn)  holds. 
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We  will  now  describe  a construction  that  at  its  nth  stage  define  : 


(i)  a depth  of  T, 

(ii)  a set  of  white  nodes  W^, 


(iii)  a set  of  red  nodes  NR  , 


(iv)  a set  of  red  nodes  OR  , 

n 

(v)  a set  of  red  nodes  R = NR  u OR  . 

n n n 


The  distribution  of  W^,  NR^,  OR^  at  the  nth  stage  of  construction  is  shown  in 

Figure  1.  Using  the  fact  that  f(x,A)  < <“  at  each  stage,  our  construction  will 

allow  us  to  accumulate  red  nodes  discarded  at  previous  stages,  the  old  red 

nodes  OR  , along  with  the  new  red  nodes  NR  encountered  at  the  current  stage 
n n 

and  white  nodes  until  at  some  achievable  stage  the  assumption  that 

f(x,A)  < “ forces  an  impossible  condition  on  W . 

n 

We  now  give  an  inductive  description  of  the  construction. 

S-tage  J:  (i)  construction  of  k^:  Since  T is  e-red,  there  is  some  b e N 

such  that 

UT(b)  n VRI  £ e2b; 

therefore  set  k^  **  b; 

(ii)  W1  = Vw  n ^(kp; 

(iii)  NRX  = VR  n JlT(k1); 

(iv)  OR^  = 4>  ( <|>  = empty  set); 

(v)  Rx  = NR-j^  u 0R1 . 


Assume  that  Stages  l,...,n  are  complete  and  consider 


A ' •'  £ frn  .>♦  A,-  «•  «*■ 
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S-tag^  n+1 : (i)  construction  of  ^n+^:  Since  the  condition 


UT(b)  n VRI  * e2 


is  true  for  b infinitely  often,  there  is  an  integer  b 


satisfying  (2.3)  and 


b > max  {f(x,  x t Rj  u 


* U Rn}* 


where 


E IRjI; 


therefore  choose  kn+^  = b; 

<U>  * K " VU  " MW' 

«“>  nr„+i  ■ u; n vr  " vw; 

(iv)  0Rn+1  - r;  n VH  „ IT(k„+l); 

<’>  R„+i  ’ NR„+i  u 0R„+r 


This  completes  the  description  of  the  construction.  Our  theorem  now 
follows  from  a lemma. 


Lemma:  For  n c N, 


|W  | < (1  - ne  + (n-1) 6)  • 2 
n 


Proof:  We  first  claim  that 


I OR  I < 62  n. 
n 


l .1  *■  A •nr  • • k >. 


F 
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To  establish  this  claim,  consider  Stage  n of  the  construction  outlined  above 
(see  Figure  1).  By  step  (iv) , 

n-1 

OR  = U Q 
n i=l  1 

where  Q £ VR  n £T(kn>  n R|.  But  for  1 < i < n 

IQ±  I * |R±  1 • max  | 0cn>  n VR  n^l, 

xcR^ 

and  since  for  ♦ defined  by  (2.4) 


kn  2 max  {f(x*  (n-l)4>(n-l))  : x £ Rx  u R2  u 
it  follows  that  for  i - l,...,n-l 

|R4 | • 6 - 2kn 

IQi'  ' (n-1)  <t>(n-l)  * 


• U Rn-1} 


Therefore 


I OR 


n-1  JR  | * 62^n 
s Z 


i=l 


(n-1)  'l'(n-l) 


(2.5) 


. n-1  |R, I 

£ «2kn  L 1 


i=l 


(n-1) 1>(n-l) 


s 62kn, 


establishing  our  claim. 


Now,  by  the  definition  of  kn. 


| OR  | + |NR  I i e2  n, 
n n 


• . •..*->  • 


'4  ■ * • • »*  t a—  * 
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Proceeding  inductively,  we  finally  obtain 
|Wn> 

<;  (1  - (n-l)e  + (n-2)  6)  • 2kn_1  • 2kn_kn"1  - (e-6)2kn 

s (1  - ne  + (n-1) 6)  • 2k°.  □ 


Returning  now  to  the  proof  of  the  main  theorem,  let  us  consider  Stage 
n * d of  the  construction.  By  (2.2)  and  the  lemma,  we  have 

|Wd | £ (1  - de  + (d-l)6)  • 2kd  < 0, 

which  is  clearly  impossible.  Thus  we  conclude  that  for  some  x t and 
0 < \ £ 1 f (x,X)  - ~.  0 


We  are  now  ready  to  prove  our  main  result.  The  constructive  proof  will 
follow  directly  from  Theorem  2,  while  the  nonconstructive  proof  relies  on  the 
following  technical  fact: 


Lemma  (Lemperti  [5]):  Let  M = A^, . . . ,An> . . . be  events  in  a sample  space  and 

let  v be  a probability  measure  such  that 

CO 

£ v(A  ) = “> 
i=l 

and  for  some  real  c > 0 

v(An  n V " E v(Aa}  v(Am) 
for  infinitely  many  n,m  c N.  Then 

v(lim  sup  A ) > 0, 
n-**> 

i.e.  the  events  A^,...  occur  infinitely  often  with  nonzero  probability. 

Theorem  3:  Let  T be  c-red  for  some  real  e > 0.  Then  T contains  an  infinite 

branch  that  is  red  infinitely  often. 

Proof  (Constructive  Version);  By  Theorem  2 we  can  inductively  form  the 
following  branch: 

(i)  Let  x^  e VR  be  the  first  node  in  an  enumeration  of  VR  u Vy 
such  that  Tx^  is  c'-red  for  some  e*  > 0 and  let  6^  be  the 
branch  from  the  root  of  T to  x^. 


(ii)  Assume  we  have  constructed  branch  (5^.  Then  T^  Is  e-red  for 
some  e > 0 and  there  is  a first  node  xn+1  in  VR  u Vy  such 
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Proof  (Non-constructlve  Version):  Let  v(A^)  be  the  probability  of  achieving  a 

branch  from  the  rest  of  T through  £^(1)  containing  a red  node  x.  Then  by 
Lemperti's  lemma  there  is,  with  non-zero  probability,  an  infinite  branch  that 
is  red  infinitely  often.  □ 

As  we  promised,  the  constructive  version  of  the  theorem  yields  more 
information  about  the  hard  path  than  the  non-constructive  proof  does.  Observe 
that  the  construction  used  in  the  proof  of  Theorem  2 requires  only  finitely 
many  evaluations  of  f(x,A)  at  known  arguments  and  that  determination  of 
f(x,A)  requires  only  Turing  machine  computations  that  ask  oracle  questions  of 
the  type  (Vn) (3k)R(n,k.x)  for  some  recursive  R.  Thus  the  procedure  is 
recursive  in  0".  Conversely,  every  0"  computation  is  recursive  in  the  f(x,A) 
construction.  The  following  corollary  states  this  precisely. 

Coro l l ary : The  function  defined  by  the  constructive  proof  of  Theorem  3 is  in 

the  Turing  degree  0". 

Proof:  By  the  observation  above,  the  construction  defines  a set  in  n ^3  in 

the  arithmetical  hierarchy  and  thus  the  construction  is  recursive  in  0"  (see 

e.g.  Theorem  VIII,  page  314  [7]).  On  the  other  hand,  given  a predicate  of  the 

form  (Vn) (3k)R(n,k) , we  may  form  the  red  tree  T,  which  has  i^,(n)  £ VR  if 

(3k)R(n,k)  and  £_(m)  £ v for  all  m > n if  ~(3k)R(n,k).  Therefore,  the  0" 

1 w 

computations  are  recursive  in  our  construction.  □ 
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